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(54) Prostate boundary segmentation from 2d and 3d ultrasound images 

(57) A fast senii-automatic prostate contouring 
method and apparatus using model-based initialization 
and an efficient Discrete Dynamic Contour (DDC) for 
boundary refinement. The user initiates the process of 
the preferred embodiment by identifying four (4) points 
on the prostate boundary, thereby scaling and shaping 
a prostate model, and then the final prostate contour is 
refined with a DDC. The method of the present invention 
has particular application during the pre-implant plan- 
ning phase of a brachytherapy procedure. However, this 
method also has uses in any phase of dose planning in 
the brachytherapy procedure or any other therapy 
approach. 
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Description 

[0001] This invention relates in general to medial imaging systems, and more specifically to a method and appara- 
tus of prostate and boundary segmentation from 2D and 3D ultrasound images. 

[0002] Prostate Cancer is the most commonly diagnosed malignancy in men over the age of 50, and is found at 
autopsy in 30% of men at the age of 50, 40% at age 60, and almost 90% at age 90. Worldwide, it is the second leading 
cause of death due to cancer in men. accounting for between 2.1% and 15.2% of all cancer deaths. In Canada, about 
20,000 new prostate cancer cases will be diagnosed and about 4,000 men will die from this disease every yean 
[0003] Symptoms due to carcinoma of the prostate are generally absent until extensive local growth or metastases 
develop, accounting for the fact that only 65% of patients are diagnosed with locally confined disease. Once the tumour 
has extended beyond the prostate, the risk of metastasis increases dramatically Tumours smaller than 1 to 1 5 cm^ 
rarely broach the prostatic capsule. When diagnosed at this early stage, the disease is curable, and even at later stages 
treatment can be effective. Nevertheless, treatment options vary depending on the extent of the cancer, and prognosis 
worsens when diagnosis occurs at an advanced stage. 

[0004] The challenges facing physicians managing patients with possible prostate cancer are to: (a) diagnose clin- 
ically relevant cancers at a stage when they are curable, (b) stage and grade the disease accurately, (c) apply the 
appropriate therapy accurately to optimize destruction of cancer cells while preserving adjacent normal tissues, (d) fol- 
low patients to assess side effects and the effectiveness of the therapy. 

[0005] U.S. Patents 5,562,095, 5,454,371 and 5,842,473 focused on challenges (a) and (b). These patents 
descnbe a 3D ultrasound imaging technique for the diagnosis of prostate cancer Extension of these concepts for pros- 
tate cryosurgery are described in commonly assigned U.S. Patent application 60/321,049, the contents of which are 
incorporated herein by reference. In another application a 3D ultrasound-guided intra-operative brachytherapy system 
IS described. An important aspect in the establishment of the appropriate prostate therapy is the accurate segmentation 
(I.e., extraction) of the prostate boundary and other anatomical structures (rectal wall, urethra, bladder). Assignment of 
the appropriate therapy or dose to the prostate requires that the prostate volume be accurately measured. 
[0006] In situations where the image contrast is great (e.g., in fluid filled regions in ultrasound images), the segmen- 
tation task is relatively easy and many approaches can be used. However, ultrasound images of the prostate are very 
difficult to segment because the contrast is low, and the image suffers from speckle, shadowing and other artifacts In 
performing ultrasound image segmentation, traditional local image processing operators like edge detectors are inade- 
quate in and of themselves for finding the boundary, due to speckle, shadowing and other image artifacts. 
[0007] The variability in prostate volume measurements using a conventional 2D technique is high, because cur- 
rent ultrasound volume measurement techniques assume an idealized elliptical shape and use only simple measures 
of the width in two views (see Tong S, Cardinal HN, McLoughlin RF, Downey DB. Fenster A, -Intra- and inter-observer 
variability and reliability of prostate volume measurement via 2D and 3D ultrasound imaging", Ultrasound in Med & Biol 
1 998; 24:673-681 , and Elliot TL. Downey DB, Tong S, Mclean CA, Fenster A, "Accuracy of prostate volume measure- 
ments in vitro using three-dimensional ultrasound", Acad Radiol 1996; 3:401-406). 

[0008] Manual contouring of sequential cross-sectional 2D CT or TRUS (transrectal ultrasound) prostate images 
has reduced this variability, but this approach is time-consuming and arduous, making it impractical during an intra- 
operative procedure. 

[0009] Region-based neural net approaches require extensive teaching sets, are slow, and make addition of user 
specified boundary information difficult. Contour-based methods, such as "snakes" implementation of active contours 
are slow, complex, and sensitive to the initial choice of contour. 

[001 0] According to the present invention, there is provided a method of object segmentation as set out in the inde- 
pendent claim. Some optional features are set in the claims dependent thereto. 

[0011] According to one embodiment, a fast semi-automatic prostate contouring method is provided using model- 
based initialization and an efficient Discrete Dynamic Contour (DDC) for boundary refinement. The user initiates the 
process of the preferred embodiment by identifying four (4) points on the prostate boundary, thereby scaling and shap- 
ing a prostate model, and then the final prostate contour is refined with a DDC. 

[00121 The method of the present invention can encompass a 2D segmentation technique or alternatively extend 
to the segmentation of objects in 3D. 

[0013] The method of the present invention has particular application dining the pre-implant planning phase of a 
brachytherapy procedure. However, this method also has uses in any phase of dose planning in the brachytherapy pro- 
cedure or any other therapy approach. 

[0014] The present invention can be put into practice in various ways. By way of example, various embodiments of 
the present invention are described below with reference to the drawings in which: 

Figure 1 shows a prior art segmentation technique using DDC. wherein Rgure 1(a) shows an initial DDC drawn by 
the user, Figure 1(b) shows the early stage of defonnation. Figure 1(c) shows the later stage of deformation, and 
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Figure 1 (d) shows the final deformed DDC. 

Figure 2 shows an example of configuration of the prior art DDC. 

5 Figure 3 shows forces as vector quantities having both direction and magnitude, for the configuration of Figure 2. 

Figure 4 shows image energy and force field for a vertical edge of an ultrasound image, wherein Figure 4(a) shows 
the edge modeled as a step edge (i.e., an edge wherein there is a drastic transition in gray levels, Figure 4(b) shows 
the energy field associated with the edge, and Figure 4(c) shows the image force field. 

10 

Figure 5 is a representation of a curvature vector, as a measure of angle between edges for (a) a large curva- 
ture, and (b) a small curvature. 

Figure 6 Flow chart showing implementation of the DDC deformation process utilized in the method of the present 
15 invention. 

Figure 7 is a flowchart for the 2D segmentation algorithm according to the present invention. 

Figure 8 shows the location of four user-selected points, labeled (1) to (4), on a prostate boundary, according to the 
20 method of the present invention. 

Figure 9 shows a first example of operation of the prostate segmentation algorithm of the present invention wherein 
Figure 9(a) shows an initial outline with four user-selected points, and Figure 9(b) shows the final segmented out- 
line obtained after deforming the DDC. 

25 

Figure 10 shows the steps of segmentation and editing in a second example of operation of the present invention 
in which portions of the DDC do not follow the prostate boundary very well, wherein Figure 10(a) shows an initial 
outline with four user-selected points, Figure 10(b) shows the DDC after a first deformation. Figure 10(c) shows 
three vertices (shown as squares) which are edited and clamped, followed by further deformation of the DDC, and 
30 Figure 1 0(d) shows the outline after second deformation. 

Figure 11 shows the segmentation of a "difficult" case according to the present invention, wherein Figure 11(a) 
shows the initial outline with four user-selected points, Figure 1 1 (b) shows the DDC after first deformation, Figure 
1 1 (c) shows five vertices (shown as squares) edited and clamped, and followed by a further defomnation of the 
35 DDC, and Figure 1 1 (d) shows the outline after second defomriation. 

Figure 12 shows a schematic diagram showing how the method to select sequences of 2D images out of the 3D 
volume to be used for the segmentation. 

40 Figure 1 3 shows a sequence of 2D images of the prostate segmented using the semi-automatic segmentation pro- 

cedure extended to 3D. The images are parallel to each other separated by 1 mm. Image no. 15 was used to initiate 
the process by the semi-automatic 2D segmentation technique. Subsequent to the segmentation of that 2D image, 
the final boundary was used to in'rtiate the segmentation of the next image. This process was repeated until the 
complete prostate was segmented. 

45 

[0015] As discussed above, DDC Is a poly-line (i.e., a sequence of points connected by straight-line segments) 
used to deform a contour to fit features in an image. When using the DDC to segment an object from an image as orig- 
inally described by Lobregt and Viergever in "A discrete dynamic contour model", IEEE Trans. Med. Imag. 1995; 14:12- 
24, the user must first draw an approximate outline of the object An example outline is shown in Figure 1 (a) for a typical 

50 2D US (ultrasound) image of the prostate. The DDC is initialized to this outline and is automatically deformed to fit fea- 
tures of interest, which in this case consist of edges that define the boundary of the prostate. Figures 1 (b) and 1 (c) show 
two stages in the deformation of the DDC. Note that points are automatically added to or deleted from the DDC as it 
deforms to allow it to better conform to the boundary. Figure 1 (d) shows the final deformed DDC. In this example, the 
final shape conforms well to the prostate boundary except in some areas where artifacts and noise in the image cause 

55 parts of the DDC to deform towards them and away from the prostate boundary. 

[001 6] The configuration of the DDC is shown in Figure 2. As illustrated, the unit edge vector d, points from vertex 
/ to vertex / + 1 . A local tangential unit vector, t is 
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(1) 



defined at vertex / from the two edge vectors associated with the vertex: where denotes magnitude of a vector. A 
local radial unit vector r,- can be computed from t / by rotating it by B/2 radians: 
r I and t / define a local coordinate system attached to vertex /. 



0 1 
-I 0 



[0017] The operation of the DDC is based on simple dynamics. A weighted combination of Internal ( • image 
(yr^) and damping (yf^) forces is applied to each vertex / of the DDC. resulting in a total force yf^h 



where iv™ and iv/"*) are relative weights for the image and internal forces, respectively, it should be noted that these 
forces are vector quantities, having both magnitude and direction as shown in Figure 3. For the prostate, image forces 
act to drive vertices towards the edges. These forces can be defined at each pixel of the 

£(x,>.)=|%,•/(:c^v-))j j4a» 

image as: 

where E represents the "energy" associated with a pixel having coordinates (x^, y^), is a Gaussian smoothing ker- 
nel with a characteristic width of <l> and / is the image. The * operator represents convolution, and ^ is the gradient oper- 
ator. The energy has a local maximum at an edge, and the force computed from the energy serves to localize this edge. 
The factor of two in Equation (4b) gives the magnitude of the image force a range of zero to two, which is the same as 
that for the Internal force defined below. A sample energy field and its associated force field for a simulated image of an 
edge are shown in Figure 4. It should be noted that image forces have effect over a limited spatial extent around an 
edge as shown by the concentration of energy around the edge in Figure 4(b). The extent of this "capture range" is 
determined by a in Equation (4a), and becomes larger as a becomes larger. Although a large capture range is desirable 
to compensate for deficiencies in the initial outlining of the DDC by the user (e.g., some vertices on the initial DDC may 
be outside of the capture range), a large value of a can result in poor localization of the desired edge. A large a also 
offers the advantage of increased noise suppression. According to a successful implementation of the present inven- 
tion, for prostate images, a value of a = 5 pixels was selected as a compromise. 

[0018] To evaluate the image force acting on vertex / of the DDC, the force field represented by Equation (4b) is 
sampled at vertex coordinates (x„ y,) using bilinear interpolation. Furthermore, only the radial component of the field is 
applied at the vertex since the tangential component can potentially cause vertices to bunch up as the DDC deforms, 
so the resultant image force at vertex / is: 

fjr, ,c, 

where • denotes a vector dot product. 

[001 9] The internal force acts to minimize local curvature at each vertex, keeping the DDC smooth in the presence 
of image noise. It is defined as: 



<EP 1 07631 8A1J_> 



4 




.0 . , ,0 



o 



where 

70 is the curvature vector at vertex /. The curvature vector is a measure of the angle between two edges as shown in Fig- 
ure 5. Although simply taking //"^ to be proportional to t could achieve the goal of minimizing local curvature, the def- 
inition in Equation (6) has the advantage of preventmg the DDC from collapsing to a point in the absence of image 
forces. 

[0020] The damping force at vertex / is taken to be proportional to the velocity ( t^,) at that vertex: 

15 



20 where wf^ is a negative weighting factor The damping force keeps the DDC stable (i.e., prevents oscillations) during 
deformation. 

[0021 ] For simplicity, uniform weights for the image, internal and damping forces were selected for the result shown 
in Figure 1 and for all subsequent segmentations. The weights were taken to be wj^^ =1 .0, w}^^ =0.3 and wf^ =-0.5 for 
each vertex. Although these values were selected experimentally, the larger weighting for the image force favors defor- 
ms mation of the contour towards edges rather than smoothing due to internal forces. Had the images been much noisier, 
a larger weight would have been given to the internal forces. The selection of a weight for the damping force appears 
to be less critical, and a small negative value was found to provide good stability. 

[0022] Deformation of the DDC is governed by the above forces and is implemented as a simple numerical integra- 
tion, depicted in Figure 6. The position of vertex / on the DDC at time r+Af is calculated from its position at time t using 
30 the following finite-difference equations: 



40 where is the position of the vertex, o y is its acceleration, m/ is its mass and At is the time step for numerical integra- 
tion. For simplicity, the mass of each vertex is taken to be unity. The initial position of each vertex (i.e., the position at 
f=0) is specified by the user-drawn contour, and the initial velocity and acceleration are set to zero. The position, velocity 
and acceleration of each vertex are then iteratively updated using the above equations. After each iteration, the DDC is 
"resampled" to add or remove vertices from it as described in greater detail below. Iterations continue until all vertices 

45 come to a rest, which occurs when the velocity and acceleration of each vertex become approximately zero (i.e., when 
||\)/||<€i and fla/||<e2 where and e2 are two small positive constants close to zero). A time step of unity is used for the 
integration. 

[0023] As discussed above, because 2D US images of the prostate suffer from speckle, shadowing and refraction, 
the boundary of the prostate is, at times, difficult to define. In addition, the contrast between the prostate and surround- 

50 ing structures is low and dependent on the system's transducer and ultrasound frequency. These effects combine to 
make the choice of initial boundary crucial in allowing the DDC to converge to the correct boundary. Vertices on the 
DDC must be initialized close enough to the desired boundary to be attracted to it and not to nearby extraneous edges. 
Accurate initialization can require substantial user effort since the user may be required to enter many points as shown 
in Figure 1(a). To overcome this problem, according to the present invention prostate-specific shape information is 

55 incorporated into the initialization phase. With this approach, it is possible to obtain a good estimate of the prostate 
boundary with very little user input. Even with good initialization, it is possible for the DDC to converge on strong non- 
prostate edges that are nearby. The incorporation of gradient direction information into the image force field can reduce 
the attraction of such features. 
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[0024] The algorithm of the present invention consists of three main phases: initialization, deformation and editing. 
Each process is described in detail below. The interaction of these processes is shown in Figure 7. After having 
selected an image and adjusting the window and level, the user must initialize the DDC by selecting four points on the 
boundary. The user may select to clamp the four points, I.e., make them Immobile. The initial DDC is then deformed. If 

5 the DDC does accurately represent the prostate boundary after being deformed, it may be edited by allowing the user 
to interactively move vertices and clamp them. The edited DDC may be further deformed if needed. 
[0025] As mentioned above, the DDC initialization routine of the present invention requires the user to select only 
four points, labeled from (1) to (4) in Figure 8. Points (1) and (3) lie on the approximate axis of symmetry. A local x-y 
coordinate system may be defined by orienting the y axis from point (1) to point (3). The x axis is then taken to be per- 

10 pendtcular to the y axis, and is oriented such that the cross product of the unit vector along the x axis and the y axis 
(i.e., X X y ) points out of the screen. The origin of the coordinate system is taken to be the average of points (1) and 
(3). 

[0026] If the initial shape of the DDC is represented in parametric form as: 



(10) 



20 where s is a parameter that varies along the curve, then points (2) and (4) are selected on the "lobes" of the prostate 
where the local tangent to the curve at these points is parallel to the y axis, i.e., points where 

x'(s)=0. (ll) 

25 [0027] The ' operator denotes differentiation with respect to s. 

[0028] The four points decompose the prostate boundary into four distinct segments: segment 1-2 which starts 
from point 1 and ends at point 2 as well as segments 2-3, 3-4 and 4-1 . The initial shape of the prostate is estimated by 
Hermltian interpolation of the endpoints to automatically obtain additional points within each segment. Cubic interpola- 
tion functions were found to provide a good approximation to a large range of prostate shapes, and have the following 

30 form: 

35 

Where s is a parameter which varies from 0 at the starting point of the segment to 1 at the ending point and a,- and /?/ 
(/=0,1,2,3) are coefficients. 

[0029] To interpolate additional points within a segment, it is first necessary to calculate the coefficients of Equation 
(12). Two pieces of data are required at each endpoint: the value of the variable (either x or y) and the rate of change 
to of that variable with respect to s (x* or /). Table 1 summarizes the information required for each segment. In the table, 
each segment is assumed to start at s=0 and end at s=1 . Several points should be noted. 

[0030] nrst, the tangents at points (1) and (3) are approximately parallel to the x axis, i.e., at these points we have 

y*{s)=0, (13) 

ts 

[0031] Here, the rate of change of x with respect to s is estimated from the user-selected points as listed in Table 
1 , which shows the data required to calculate coefficients for interpolation functions for each segment (1 -2, 2-3. 3-4 and 
4-1), where (x^, y^). (xg, y2), (X3, ya) and (X4. y^) refer to the coordinates of the four user-selected points shown in Rg- 
ure 3. 

K> [0032] Second, at points (2) and (4) where Equation (1 1 ) holds, the rate of change of y with respect to s must also 
be estimated as listed in the table. With these data, the coefficients can then be calculated using the formulae: 




and 
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= v(0) i>3 ^.v<0)^ v'(l)-2> (O) 

^y '{0) b-. =2MO»-.v(l)W/(0>-v 'll). 

5 



[0033] Once the coefficients are calculated, points are unifonmty interpolated within each segment at every As=0.1 
units. Figure 9{a) shows the initial DDC estlnnated for the prostate image shown in Figure 1. 
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Table 1 





x(s) 


y(s) 




x(0) 


X(1) 


x'(0) 




y(0) 


y(i) 


y(o) 


/(I) 


1-2 


x^ 


^2 


X2 - X4 


0 


yt 


y^ 


0 


ya-yi 


2-3 


^2 


^3 


0 


X4 - X2 






y3-yi 


0 


3-4 


^3 


X4 


X4 - X2 


0 


ya 




0 


y^ -ya 


4-1 


X4 




0 


X2 - X4 


y4 




yi -ya 


0 



[0034] After initialization, the DDC is deformed as described in detail above. The four user-selected points chosen 
during the initialization phase can be clamped prior to deformation to prevent them from moving or they can be 

25 undamped allowing them to move with the rest of the DDC. 

[0035] Although the initialization routine of the present invention is able to represent a wide range of prostate 
shapes, the initial shape may fall near strong edges representing other tissues or artifacts. These may pull the DDC 
towards them and away from the desired (prostate) boundary if the image forces defined by Equations (4) and (5) are 
used. The attraction of such boundaries can be reduced by using directional information, as descibed in Worring M, 

30 Smeulders AWM, Staib LH, Duncan, JS, "Parameterized feasible boundaries in gradient vector fields", Computer Vision 
Image Understanding 1996; 63:135-144. For US images of the prostate, this information represents the fact that the 
interior of the prostate appears darker than the exterior. Such information can be applied at vertex / of the DDC by mod- 
ifying Equation (5): 

0. othcmisc 



40 

[0036] It is important to note that f (x, y) is an outward-pointing unit radial vector as defined by Equation (2). 
According to Equation (15), if the gray levels in the vicinity of vertex / vary from dark to light In the direction of the outer 
radial vector, a force is applied to the vertex: otherwise, no force is applied. Figure 9(b) shows the DDC after deforma- 
tion. 

45 [0037] During deformation, the distance between adjacent vertices on the DDC can become larger, resulting in 
poor representation of the prostate boundary. After each iteration represented by Equation (9), the DDC is resampled 
so the distance between adjacent vertices is maintained at a uniform value of 20 pixels, which has been found to pro- 
vide a good representation of the prostate boundary. When no vertices are clamped, resampling can be done very eas- 
ily. First, the x and y coordinates of each vertex are represented in parametric form as in Equation (10). However, the 

so parametric variable s is chosen to be the length of the cun/e from the first vertex to the vertex in question. The curve is 
then resampled along its entire length at equally-spaced values of length by linear interpolation of the existing vertices. 
This results in a new set of vertices which are used to represent the curve, with the old ones being discarded. This 
approach presents a problem when some vertices are clamped since the clamped vertices may be eliminated after 
interpolation. To avoid this, clamped vertices are simply inserted back into the DDC after interpolation. 

55 [0038] In extreme cases, the initialization routine may not place all of the verttees on the DDC close to the actual 
prostate boundary. Figure 1 0(a) shows an example where some portions of an initial DDC (indicated by the arrows) are 
distant from the prostate boundary. As shown in Figure 1 0(b), this portion of the DDC does not converge on the desired 
boundary since image forces have a limited capture range. It is possible to correct the segmented boundary by editing 
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the DDC and re-deforming it. The user can drag a vertex on the DDC towards the desired boundary. The vertex may 
then be "clamped" so it does not move when the DDC is re-deformed. Figure 10(c) shows a case where three vertices 
(as indicated by the squares) have been dragged closer to the prostate boundary and clamped. When a vertex is moved 
and clamped, adjacent vertices generally deform towards the clamped vertex under the influence of internal forces to 

5 minimize local curvature. If these vertices move to within the capture range of the prostate boundary, image forces carry 
the vertices the rest of the way to the boundary. The DDC after deforming it again is shown in Figure 1 0(d). 
[0039] The examples in Figures 9 and 10 represent cases that are of "little" or "medium" difficulty to segment. A 
more challenging example is shown in Figure 1 1 where the prostate has a bulge at the top. This shape is difficult to ini- 
tialize with cubic interpolation shape functions. One contouring strategy is to initialize the DDC by ignoring the bulge as 

10 shown in Figure 1 1 (a). The DDC does not deform into the bulge as shown in Figure 1 1 (b). Vertices along the top can 
be dragged and clamped into position as shown in Figure 1 1 (c). The final segmented outline is shown in Figure 1 1 (d). 
[0040] Other embodiments and variations are possible. For example, although the prefen-ed embodiment set forth 
herein addresses the problem of prostate segmentation, the principles of the invention may be applied to boundary seg- 
mentation of any solid object, including other organs within the human or animal anatomy, provided suitable modifica- 

15 tions are made to the interpolations functions used to initialize the boundary prior to deformation. 

[0041] Also, whereas the method according to the prefen-ed embodiment is set forth as a 2D segmentation tech- 
nique, it can be extended to segmentation of objects, such as the prostate, in 3D. Because the surface of the organ is 
continuous, a 2D image slice which is separated by only a small spacing from adjacent parallel slices is characterized 
by a similar boundary to the boundaries of the adjacent slices. Thus, by slicing an object (i.e. organ) in parallel slices 

20 with a sufficiently small spacing, the boundary of the object in adjacent 2D slices will be similar. Accordingly, the seg- 
mented boundary in one slice may be used as an initial boundary for the segmentation process in the adjacent slices. 
If the object boundaries are sufficiently close, then the use of the initial boundary in the adjacent slices results in fast 
segmentation, without the need for editing. 

[0042] The 3D embodiment of the present invention has been successfully implemented using a 3D ultrasound 

25 image of a patient's prostate. The 3D image was sliced in parallel slices 1 mm apart to produce 35 transaxial slices of 
the prostate. The approximate central slice was chosen as the starting slice (i.e., slice number 15). The prostate in this 
slice was segmented by the technique described above using 4 seed points. This image required no editing, and the 
resulting boundary produced by the segmentation is shown in panel 15. This boundary was then used to initialize the 
segmentation of the adjacent slices 14 and 16. The resulting segmented boundary (without editing) is shown in panels 

30 14 and 16 of Figure 12. The segmented boundary in slice 14 was then used as the initial boundary for slice 13, and the 
segmented boundary in slice 1 6 was then used as the initial boundary for slice 1 7. This process continued until the seg- 
mentation of slices 1 and 34 was complete. The results of the complete process are shown In the panels of Rgure 12. 
[0043] Although the example presented herein above was based on parallel transaxial slices, a person of ordinary 
skill in the art will appreciate that the prostate (or any 3D object) can be sliced in any regular manner for this 3D seg- 

35 mentation approach. For example, the prostate (or any 3D object) can be sliced in parallel slices in the coronal, sagittal 
or oblique direction, as well as in radial directions to produce radial slices with an axis through the center of the prostate 
(or any other axis) as shown in Figure 1 3. The axis for radial slicing can be defined by the any two opposing points used 
as seed points to initialize the segmentation in the central slice. The radial slicing can be at equal angles, e.g., 1 degree, 
or varying angles depending on the complexity of the surface of the object. 

40 [0044] All such embodiments and variations are believed to be within the sphere and scope of the invention as 
defined by the claims appended hereto. 



1- A method of object segmentation using an ultrasound image, comprising the steps of: 

selecting a first plurality of seed points in said ultrasound image which lie at least approximately on a boundary 
of said object; 

generating an initial contour of said organ by interpolating additional seed points which lie at least approxi- 
mately on said boundary using interpolation functions chosen to approximate the shape of said object; and 

automatically deforming at least said additional seed points to generate a further plurality of points outlining the 
shape of said object. 



2. The method of claim 1 , further comprising the steps of interactively moving said further plurality of points and auto- 
matically defomriing said further plurality of points to generate a final plurality of points outlining an edited shape of 



Claims 



55 



said object. 
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3. The method of claim 1 or 2, further comprising the step of clamping at least one of said first plurality of seed points 
or said further plurality of points at their respective positions prior to respective ones of said steps of automatically 
deforming. 

5 4. The method of claim 1 , 2 or 3, wherein each said step of automatically deforming further comprises the step of con- 
verging each of said points on boundary edges of said object using a Discrete Dynamic Contour (DDC) algorithm. 

5. The method of claim 1, 2 or 3, wherein said step of electing said first plurality of seed points further comprises 
selecting first and third points lying approximately on a first axis of symmetry of said object and selecting second 

10 and fourth points lying approximately on a second axis of symmetry orthogonal to said first axis of symmetry. 

6. The method of claim 5. wherein said step of generating said initial contour further comprises the steps of (i) calcu- 
lating respective coefficients of said interpolation functions from the respective positions of said first and third 
points, and said second and fourth points, and (ii) uniformly interpolating line segments between said first and sec- 

15 ond points, said second and third points, said third and fourth points, and between said fourth and first points using 

said interpolation functions. 

7. The method of claim 6, wherein the step of uniformly interpolating further comprise perfomning a Hermitian inter- 
polation of said line segments in accordance with first and second cubic interpolation functions. 



8. The method of claim 4, wherein said step of converging each of said points on boundary edges of said object fur- 
ther comprises the step of modifying said Discrete Dynamic Contour (DDC) algorithm to apply image forces on said 
points only in the event that gray levels adjacent respective ones of said points vary from dark to light in an outward 
radial direction for each of said points. 



9. The method of claim 4, wherein said step of converging each of said points on boundary edges of said object fur- 
ther comprises the step of maintaining respective distances between respective ones of said points with successive 
iterations of said DDC algorithm at no less than 20 pixels. 

30 10. The method of claim 1 , further comprising the steps of selecting said further plurality of points outlining the shape 
of said object in one image plane through said object as respective ones of said additional seed points to which 
said step of automatically deforming is applied for an adjacent parallel image plane through said object in order to 
outline the shape of said object in three dimensions. 

35 11. An apparatus for object segmentation using an ultrasound image, comprising:- 



25 



means for obtaining an ultrasound image; 

processing means for selecting a first plurality of seed points in said ultrasound image which lie at least approx- 
imately on a boundary of said object: by 



40 



generating an initial contour of said organ by interpolating additional seed points which lie at least approx- 
imately on said boundary using interpolation functions chosen to approximate the shape of said object; 
and 



45 



automatically deforming at least said additional seed points to generate a further plurality of points outlin- 
ing the shape of said object; and 



means for displaying said generated surface contour. 



50 



55 



OCID: <EP 1 07631 8A1J_> 



9 



EP1 076 318 A1 



Vi 



i-1 



1+1 



FIGURE 2 



3CID:<EP 1076318A1 I > 



11 




OCID: <EP 107631BA1J_> 



13 



EP 1 076 318 A1 




EP 1 076 318 A1 



User draws 
initial DOC 



Set pXt 


= 0) to 


initial DDC. 


Set v, (/ = 


= o)=6. 


Set a,(/ 


:=0)=6. 



Resample DDC: 
add or remove 
vertices 



T 



No 



Update V,, 
a, from time / 
to I ^ using 
Equation (2). 




FIGURE 6 



X;iD: <EP 107631 8A1J_> 



15 




EP 1 076 318 A1 




FIGURE 8 



OCID:<EP 1076318A1 I > 



17 



EP 1 076 318 A1 




FIGLRE iO 



OCiD: <EP l07e3l6A1J_> 



19 




X^ID: <EP 1 07631 aAl_l_> 



20 



EP 1 076 318 A1 




FIGURE 12 



21 



EP 1 076 318 A1 





DCID: <EP 1076318A1 J_> 



22 



EP 1 076 318 A1 




OCID: <EP 107631 BA1J_> 



23 



EP 1 076 318 A1 



No. 13 



No. 14 





No. 15 



No. 16 





No. 17 



No. 18 





---- — - 










/' 

[ 














24 

CID:<EP 107631BA1J > 



EP1 076 318 A1 





OCID: <EP 10763iaAl_L> 



25 



EP 1 076 318 A1 



No. 25 No 26 




26 

CID: <EP 10763iaAl J_> 




EP 1 076 318 A1 



No. 31 



No. 32 




EP 1 076 318 A1 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Apprlcation Nufnb«r 

EP 00 30 2140 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation ot document with indication, where appropriate. 
of retevant passages 



Relevant 
\o claim 



CLASSIFICATION OF TH£ 
APPLICATION (InLCl.T) 



US 5 559 901 A (LOBREGT STEVEN) 
24 September 1996 (1996-09-24) 
* abstract * 
column 1, line 

line 41 
line 26 
line 



1-4,11 



G06T5/00 



column 1, 
column 2, 
column 5, 
column 11, 



9 - line 18 * 
line 44 * 

- line 32 ♦ 

10 - line 50 * 



line 58 - line 60 * 



AARNINK R G ET AL: "AN EDGE DETECTION 
SCHEME FOR PROSTATE BOUNDARY 
DETERMINATION" 

PROCEEDINGS OF THE ANNUAL INTERNATIONAL 
CONFERENCE OF THE ENGINEERING IN MEDICINE 
AND BIOLOGY SOCIETY, US, NEW YORK, IEEE, 
vol. CONF, 15, 

28 October 1993 (1993-10-28), pages 

230-231, XP000436732 

* page 230, paragraph METHODS * 



5-10 



1-11 



TECHNICAL FIELDS 
SEARCHED <int.CI.7> 



G06T 



The present search report has been drawn up lor all daims 



F1ac«o(Maich 

THE HAGUE 



Dat* of oomptetion ol tfw s*aich 

11 October 2000 



Exainingr 

Gonzalez Ordonez, 0 



CATEGORY OF CITED OOCUMEmS 

X : pwticutarly ralovanl t takan aloiw 

Y : paitlculany relevant 1 combined wHh another 

<iocument d the aame category 
A : tftchrtologlcai t>acl(ground 
O : non-wnttan dtecloaure 
P ! Mermedlate document 



T theory or princpte urvSerlying the invention 
E earlier patent document, but published on. or 

aner the Wing date 
D : document cited m the application 
L : document cited tor other reasons 

* * 'I^a*^ °* same patent family, con-esponding 
document 



28 



CID: <EP 107631 BA1J_> 



EP1 076 318 A1 



ANNEX TO THE EUROPEAN SEARCH REPORT 
ON EUROPEAN PATENT APPLICATION NO. 



EP 00 30 2140 



This armax lists the patent famity members relating to ttie patent documents cited in the atsove-mentioned European search report 
The members are as contained in the European Patent Office E DP me on 

The European Patent Office is in no way tiabte for ttiese particulars which are merely given for the purpose of information. 

11-10-2000 



Patent document 
cited in search report 



Publication 
date 



Patent family 
member(s) 



Publication 
date 



US 5559901 



24-09-1996 



EP 
JP 



0633548 A 
7057102 A 



11-01-1995 
03-03-1995 



i For mora details about this armx : see Official Journal of the European Patent Office. Mo. 12/82 



29 



CX:iD: <EP 1076318A1_L> 




THIS PAGE BLANK (uspto) 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 



BEST AVAILABLE IMAGES 



Defective images within this document are accurate representations of the original 
documents submitted by the appUcant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 



□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 



IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 




COLOR OR BLACK AND WfflTE PHOTOGRAPHS 



□ OTHER; 



THIS PAGE BLANK (uspto) 



